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(57) ABSTRACT 

A compact, handheld imaging apparatus which can be used 
to capture high-quality iris images for identification of a 
person. The handheld iris imager is non-invasive and non- 
contacting and comprises a camera, a cold mirror, a lens, and 
an illuminator. The imager has sensors and indicators which 
assist a user in aligning and focusing the device. The imager 
also automatically captures the image when proper position- 
ing is achieved. A template of the image is then compared to 
a database of previously stored templates of images to 
identify the person. The imager is integrated into a telephone 
as a security module. The telephone cannot be unlocked and 
used unless a user has been identified and authorized by the 
imager. 

33 Claims, 6 Drawing Sheets 
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IRIS IMAGING TELEPHONE SECURITY having a image plane disposed in front of the front surface 

MODULE AND METHOD °f foe iris acquisition means; a mirror disposed on a side of 

the lens opposite the iris acquisition means; an illuminator 

FIELD OF THE INVENTION disposed along a side of the mirror; a memory for storing an 

s iris image obtained by the iris acquisition means; a processor 

The present invention relates in general to identification fof cxtracting a template from the stored iris image; and a 

of physical characteristics of a human being or other animal. communications interface for transmitting the template to a 

More particularly, the present invention relates to iris rec- cen tral station. 

ognition. According to one aspect of the invention, the iris acqui- 

BACKGROUND OF THE INVENTION 10 s ^ on rneans comprises a camera, and the mirror is a cold 

mirror. The camera is sensitive to light having a wavelength 

Various technologies are used for uniquely identifying a m a range between about 400 nm and about 1100 nm. The 

person in accordance with an examination of particular mirror reflects light having a wavelength in a range between 

attributes of either the person's interior or exterior eye. One about 400 nm and about 700 nm and passes light having a 

of these technologies involves the visual examination of the 15 wavelength greater than about 700 nm. 

particular attributes of the exterior of the iris of at least one According to another aspect of the present invention, the 

of the person's eyes. The iris of the human eye has random illuminator emits fight having a wavelength in a range 

patterns of striations, ciliary processes, crypts, rings, farrows between about 680 nm and about 900 nm towards the iris of 

and other features which had been shown capable of gen- ^ cye being [ magc ^ an d the eye is out of contact with the 

erating highly unique biometric templates for personal iden- 20 ^ i ma g m g apparatus 

f^o^/^D^^ -r^'c Q ? iS » madC ?, U r?i* Pa \ N i°* According to another aspect of the present invention, the 

4 'Vt^ 9 n ? vr R Tfof^n \ lS&U f Z *°dule ***** comprises at least a visible indicator or an 

and U.S. Pat. No. 5 291 560 "Biometnc Personal Identifi- tor to wnen ^ of ^ ^ ^ 

cation System Based on Ins Analysis , issued to Daugman. been Accordi to another t of the t 

As made clear by these patent the visible texture of a 25 ^ ^ & a focus assessment 

person's ins can be used to distinguish one person from ^ d to ^ ^.^ ^ audible 

another with great accuracy. Thus, ins recognition can be indicator 

used for such purposes as controlling access to a secure ' ... 

facility or a bank automatic teller machine, for example. An According to another aspect of the present invention, the 

iris recognition system involves the use of an imager to 30 processor unlocks a telephone responsive to a signal 

video image the iris of each person attempting access, and received from the central station. 

image processing means for comparing this iris video image In a further embodiment within the scope of the present 

with a reference iris image on file in a database. invention, a method of unlocking a telephone responsive to 

Iris identification systems have been developed that are ^ identification of a person comprises the steps of: (a) 

capable of collecting images of the iris and processing them 35 storing image information of the iris of at least one person's 

to produce biometric templates. These templates may be eye; (b) illuminatmg an eye of an unidentified person having 

used to identify individual irises with extremely low error ™ iris; (c) obtaining an image of the ins of the unidentified 

rates, on the order of 1 in 10 78 . The systems capture the iris Person; (d) determining if the image is an image of sufficient 

images using stationary optical platforms that are often W&ty for a step (f) of comparing; (e) repeating steps (b) 

large, complex, and expensive. The systems are difficult to 40 through ( d ) until me ima S e °/ sufficient quality is obtained; 

use with minimal cooperation of the subject being identified. © comparing a template of the obtained image with the 

As a result their usefulness in many applications is limited. stored image information to identify the unidentified person; 

^ , , , «_ . * , , and (g) unlocking the telephone responsive to a result of the 

™! fJin 1 " ^ eph ? n6 ft V*f yCal n 3 h 65 " step °f comparing. Hie stored image information used for 
mated $650 million to cellular fraud principally due to ^ J^^l can % e a mds or te 4 late „ tracted from ^ 

cloning of cellular telephones. Cloning involves and rison can be erformed at a central 

re-proeramnine a phone s electromc serial number and Ja ? • * ■ j u *iu • *j 

i & piw^iauim B y database maintained by a telephone service provider, 

telephone number to those stolen from a legitimate sub- J r ... 

scriber. To counteract cloning, some service providers have According to one aspect of the present invention, the 

utilized personal authentication techniques such as personal method comprises the step of activating an indicator 

identification numbers (PIN) or voice verification to verify 50 * the ima S c is of ^sufficient quality. The indicator is an 

that the authorized subscriber is using the phone. This is audible indicator. 

unreliable because PIN number can be stolen or forgotten, According to another aspect of the present invention, the 

and voice verification messages may be recorded. method further comprises the step of activating an indicator 

Although the art of human recognition systems is well 55 the image is of sufficient quality. The indicator is a visible 

developed, there remain some problems inherent in this indicator. 

technology, particularly the lack of an iris imager and According to another aspect of the present invention, the 

security module suitable for integration into a cellular method further comprises the step of activating an indicator 

telephone, and the lack of a method for using biometric responsive to the step of comparing. The indicator is a 

information for enabling access to the cellular network. 60 visible indicator. 

Therefore, a need exists for a recognition system that [n accordance with a further aspect of the present 

overcomes the drawbacks of the prior art. invention, the step of determining if the image is an image 

of sufficient quality comprises the step of focus assessment 

SUMMARY OF THE INVENTION processing the image. 

The present invention is directed to a telephone security 65 According to another aspect of the present invention, the 
module comprising: iris acquisition means having a front telephone is unlocked if the step of comparing identifies the 
surface for obtaining an image of an iris of an eye; a lens person. 
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In a further embodiment within the scope of the present FIG. 10 is a flow diagram of an exemplary method of 

invention, a system of identification of a person for unlock- operation of a telecommunications iris imager in accordance 

ing a telephone comprises a telephone security module, a with the present invention, 
second memory for storing at least one template of at least 

one image of an iris of at least one person's eye; and a s DESCRIPTION OF EXEMPLARY 

second processor for comparing the template of the stored EMBODIMENTS AND BEST MODE 

iris image with the at least one stored template of the second ^ prcsent invention is directed to a compact, handheld 

memory to identify the person, and for unlocking the tele- imaging apparatus and method which can be used to capture 

phone responsive to the result of the comparison. high-quality iris images. Preferably, the imager has sensors 

In accordance with a further aspect of the present 10 and indicators which assist the human operator in aligning 

invention, the second memory and second processor are and focusing the device. The imager also automatically 

housed in a central station remote from the telephone captures the image when proper positioning is achieved, 

security module. Because it is small and compact, it is practical for integration 

In accordance with a further aspect of the present into a cellular telephone where it is used to authenticate 

invention, the second processor unlocks the telephone when 15 telephone subscribers and eliminate cellular telephone fraud, 

the template of the stored iris image substantially matches Throughout the following detailed description similar ref- 

the at least one stored template of the second memory. erence numbers refer to similar elements in the figures of the 

In a further embodiment within the scope of the present drawings, 

invention, a telephone security module comprises: iris FIG. 1 illustrates a preferred embodiment of the handheld 

acquisition means having a front surface for obtaining an 20 imager 100 in accordance with the present invention. The 

image of an iris of an eye; a lens having a image plane exemplary handheld, non-invasive, non-contacting iris 

disposed in front of the front surface of the iris acquisition imager comprises iris acquisition means 105, an imaging 

means; a mirror disposed on a side of the lens opposite the lens 110, a mirror 120, an optional diopter correction lens 

iris acquisition means; an illuminator disposed along a side 125, and an illuminator 130. The imager 100 is preferably 

of the mirror; a first memory for storing at least one template 25 powered by a standard DC supply provided by a cellular 

of at least one image of an iris of at least one person's eye; telephone. 

a second memory for storing an iris image obtained by the The iris acquisition means 105 is preferably a conven- 

iris acquisition means; a processor for extracting a template tional solid state video camera, such as a charged coupled 

from the stored iris image; and a comparator for comparing ^ device (CCD) or complementary metal oxide semiconductor 

the template from stored iris image with the at least one (CMOS) device. A preferred camera is a x h inch format, 

template to identify the person. monochrome CCD board camera, such as Computar Model 


BRIEF DESCRIPTION OF THE DRAWINGS 


EM200. Preferably, the video camera 105 is sensitive to light 
of wavelengths in the range of about 400 nanometers to 


The foregoing and other aspects of the present invention 35 about 1100 nanometers, and is positioned so that its front 

will become apparent from the following detailed descrip- surface coincides with the image plane of the lens 110 in 

tion of the invention when considered in conjunction with front of "it. In the preferred embodiment, the object plane of 

the accompanying drawings. For the purpose of illustrating the lens is approximately 89 mm in front of the lens 110. 

the invention, there is shown in the drawings an embodiment More preferably, the lens 110 is an optical lens with approxi- 

that is presently preferred, it being understood, however, that 4Q mately 14.2 mm focal length. 

the invention is not limited to the specific methods and The mirror 120, preferably a concave cold mirror having 

instrumentalities disclosed. In the drawings: a radius of curvature preferably about 276 mm, is disposed 

FIG. 1 is a schematic diagram of an exemplary iris imager on the side of the lens 110 opposite the video camera 105 and 

in accordance with the present invention; creates a magnified virtual image of the iris behind the 

FIG. 2A is a schematic diagram of the imager of FIG. 1 45 mirror 120. In the preferred embodiment, the mirror 120 

shown in greater detail; reflects visible light with wavelengths in the range of about 

FIG. 2B is a schematic diagram of another exemplary 400 1 ° about 700 nanometers, and passes light haying longer 

imager in accordance with the present invention; wavelengths, such as those in the range of about 700 to about 

FIG. 3 is a simplified flowchart of a method of operation 

in accordance with the present invention; 50 The illuminator 130 is positioned just outside the edge of 

. . , *■ j* c 1 •** the cold mirror 120 and is used to illuminate the iris of the 

FIG. 4 is a schematic diagram or an exemplary ins image * . * i_ * *j * ^ j r™ c , .„ . 

t j t . subject being identified. The preferred illuminator 130 emits 

recognition system m accordance with the present invention; A, & , c r , 4£flftt , . 

. to J r ' light having wavelengths 01 about 680 to about 900 nanom- 

FIG. 5 is a schematic diagram of an exemplary ins imager et£rs PreferablVy me iUu minator 130 is a miniature quartz 

having visual and aural indicators in accordance with the $$ halogeQ or krypton gas bulb operatillg at approximately 1 

present invention; watt 

FIG. 6 is a more detailed flow chart of a method of ^ imager acquifes images of an ^ with sufficient 

operation m accordance with the present invention; focus? md sizc for usc with 

FIG. 7 is a schematic diagram of an exemplary iris image processing and comparison routines, preferably in less than 
recognition system having a focus assessment processor in 60 aDout 3 seconds. A preferred image processing and corn- 
accordance with the present invention; parison routine is described in U.S. Pat. No. 5,291,560, 

FIG. 8 is a schematic diagram of an exemplary iris imager "Biometric Personal Identification System Based on Iris 

incorporated into a telephone in accordance with the present Analysis", issued to Daugman, and commonly assigned with 

invention; the present invention to IriScan Inc., and incorporated herein 

FIG. 9 is an isometric view of an exemplary telecommu- 65 by reference. However, any processing and comparison 

nications iris imager and telephone in accordance with the technique can be used with the image that is acquired at the 

present invention; and imager, such as the image pixel correlation technique 
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described in U.S. Pat. No. 5,572,596, "Automated, Non- by the mirror 120 and forms an approximately centered 

Invasive Iris Recognition System and Method", issued to image 109 of the eye 150 at the image plane 107 of the 

Wildes et al. and the techniques described in U.S. Pat. No. camera 105. The image is then captured and processed, as 

4,641,349, "Iris Recognition System", issued to Flom et al., described below. 

both of which are incorporated herein by reference. 5 Although a cold mirror (one which reflects shorter wave- 

FIG. 2A shows the apparatus of FIG. 1 in greater detail. ^ngths and passes longer wavelengths) is described herein, 

The lens 110 gives a high resolution image of the eye 150 of U 15 understood that a hot mirror (one which reflects longer 

. ^ , . - , e Jr , -i -i a iL ^ wavelengths and passes shorter wavelengths) could also be 

the user, who is positioned m front of the lens 110, so that , . * A * ... * ■ *• c u 

' -ml*. *u «a j ,t_ • 1rtn used m accordance with the present invention. Such a 

extreme proximity between the eye 150 and the imager 100 confi tion fe shown m ^ ^ m ^ nGi 2B< ^ eye 

is not ^required {i t ,,no contact is needed between the subject io 15Q * muminated by an illummator 131 emitting nghi 

and the imager 100). having wave lengths in the range of about 680 to 900 

The handheld iris imager comprises a solid-state image nanometers. This light is reflected by the eye 150 and the 

capture device and an optical system which forms an image, light having wavelengths in the range of about 700 to 900 

109 of the iris on the image capture device at the image plane nanometers is reflected by the hot mirror 121 to be focused 

of the video camera 105 and at the same time produces a 15 by the lens 111 onto the front surface of the camera 106. 

virtual image 115 of the iris which the user can use to Light reflected from the eye 150 having shorter (visible) 

position and focus the iris image. As a result, the user can, wavelengths in the range of about 400 to 700 nanometers 

using the same eye being imaged, see a reflected image of passes through the hot mirror 121 and strikes a concave 

the iris which can be used to position the handheld imager broadband mirror 122 which reflects light having wave- 

100 so that a good iris image (i.e., an image that can be 20 length from about 400 to 900 nanometers. This light forms 

processed and compared to those stored in a database) can a virtual image 115 of the eye 150 behind the concave mirror 

be obtained. 122 that the user can see and use to align and focus the 

FIG. 2A also shows an optional dioptric correction lens device, as described below. 
125 positioned between the eye 150 and the cold mirror 120. 25 The imager 100 of FIGS. 1 and 2A, as well as the imager 
The dioptric correction lens 125 is an adjustable optical of FIG. 2B, is used in a system to identify the iris image that 
element which corrects for the close-range focusing ability has been captured. As shown in FIG. 3, the eye is illuminated 
of the individual eye, which varies from subject to subject, at step 160, and an acceptable or suitable image of the iris 
When the lens 125 is properly adjusted, the magnified, is obtained at step 165. The image is processed to extract an 
reflected virtual image 115 of the subject's eye appears in 3Q iris template or code at step 170, the template or code is 
sharp focus to the subject at the same eye-to-mirror distance encrypted (optional) and transmitted to the cellular provider 
at which the subject's eye is sharply focused on the front (such as a central station; e.g., a Mobile Telephone Switch- 
surface of the camera. This simplifies use of the imager, ing Office) at step 175, and the template or code is decrypted 
because the subject simply positions the image so that the (if necessary) and compared to pre-existing templates or 
virtual image 115 of the iris appears sharply focused. 35 codes of authorized subscribers stored in a memory or 

A preferred embodiment of the dioptric correction mecha- database for identification and authorization of the user at 

nism has no correction lens 125 and instead has a mechani- step 180. If the user is authorized, the cellular provider 

cal means (not shown) for adjusting the position of the cold enables the call placement at step 185. The cellular provider 

mirror 120 relative to the camera lens 110. This allows the can either enable the call at the central station or send a 

user to vary the object distance of the cold mirror 120, thus 40 signal to the telephone processor directing it to unlock the 

changing the eye-to-lens distance at which the virtual image telephone. 

115 of the iris is sharply focused. FIG. 4 is a schematic diagram of an exemplary iris image 

The ability to set the dioptric correction mechanism to recognition system in accordance with the present invention, 

accommodate a particular user has a great utility if the The imager 100 is coupled to a microprocessor 210 that 

imager is used by only one person most of the time. Once the 45 performs the processing and encryption. The microprocessor 

correction is set, the user can easily position the device to 210 resides in a cellular telephone 200. 

obtain a sharply focused reflected image. This automatically The microprocessor 210 is coupled to the imager 100 via 

produces a sharply focused image from the camera and conventional cables and/or printed circuit boards (PCBs) 

substantially immediate acceptance of the image by the that are incorporated into the telephone 200. Other conven- 

focus assessment processor described below. Image capture 50 tional means for coupling the imager 100 and the micro - 

time is thereby reduced and overall convenience and utility processor 210 can be employed. The microprocessor 210 

is enhanced. controls the imager 100 and runs software held in read only 

An eye 150 is positioned in front of the imager 100 (e.g., memory (ROM) 205. The processor 210 is connected via a 

about 3.5 inches in front), as shown in FIG. 2A, and the bus 207 t0 ROM 205, a random access memory (RAM) 

illuminator 130 is turned on. This, in turn, illuminates the 55 another memory such as an erasable programmable 

eye 150 and the iris therein. Preferably, the light having ROM (EPROM) 230, and an input/output (I/O) controller 

wavelengths of about 400 to about 700 nanometers is 225. The RAM 232 is large enough to hold at least one 

reflected by the cold mirror 120, thereby forming a magni- captured image of an iris. The I/O controller 225 is con- 

fied virtual image 115 behind the mirror 120 which the user nected to me appropriate circuitry and drivers (not shown) 

can see through the eye being imaged. The radius of 60 for issuing commands to control the imager 100. 

curvature of the mirror is selected so that the magnified The imager 100 preferably uses a digital camera and 

image 115 of the eye substantially fills the user's entire field transmits digital images directly to the processing unit 210. 

of view. Hence, when the imager 100 is positioned so that "On/off" data is transmitted from the imager 100 to the 

the entire e^e-15Q.is^isible , it is virtually assured that the processor 210 to initiate the image acquisition function. A 
ey e_150 wijl be sub stantially ^ccr^^dl^fob]e^lmeT^ 65 digital image could be provided if a digital camera is used: 

^fthe camera^05~UnlleTthese^ The image processing consists of a number of image 

wavelengthsof-about 700 to about 900 nanometers is passed processing steps (such as those described in U.S. Pat. No. 
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5,291,560 and U.S. Pat. No. 5,572,596, which are herein If the image is not suitable at step 360, then at step 380, 

incorporated by reference) which lead to extraction of a the indicators) is activated (e.g., a beep sound is issued), 

unique and highly specific digital biometric template that and processing continues at step 355 (i.e., another image is 

can be used to identify the individual based on intensity obtained). 

patterns within the iris. The biometric template is transmit- 5 Because the eye's own focusing system automatically 

ted to the cellular provider where it is compared against adjusts to bring the virtual image 115 into sharp focus to the 

other templates stored in a memory or database. The data- user, it cannot be relied upon to always accurately focus the 

base stores selected data representing images of the iris of a e Y e on ^ camera 105 - For this Purpose, a focus 

plurality of subjects. A match of the biometric template with assessment system is used in one embodiment, as shown m 

a template stored in the database identifies the subject whose 10 FIG - 7 - Di S ital ™ a 8 e information from the imaging 

iris is being imaged. device 100 is stored in a frame buffer memory 410, such as 

A141 _ , * a * j i_ i * al a RAM similar to RAM 232 described above with respect to 

Although an image of the eye is reflected back to the ™~ A , , , r 4 . i * c r 

„ . * < j . * j • j FIG. 4, and capable of storing one complete frame of 

subiect in mirror 120, this may not provide the desired , f - A c * 

r i_ i * ,i_ L1 \ , ... digitized video information. A focus assessment processor 

feedback to the user to enable the user to properly position A zL . . . r \ 

. iU t . . , . . . \ *\ , . i „ 420 accesses the digitized image rnformation and applies 

the imager so that a suitable ins image is obtained. For 15 . . f , & , j- • 1 • 

! & , . . » j ...... certain measurement algorithms which are disclosed in a 

example, a user may be a novice in using and positioning the t . & , ~ A „ 

Vnn i*a *if i co-pending application entitled Video-Rate Focus 

imager 100 with respect to the eye 150, or the user may be A % Jr*. ... ... „ 

„ A ■ / iL « * j iL iL Assessment , filed concurrently with this application Ser. 

attempting to image the eye of another subject with the KT £rtirtn n(Cn KT ~ c in( , 0 ; , . r , JU . , 

1W - & U1 ,/ . 1AA . No. 60,109,960 Nov. 25, 1998, and incorporated herein by 

imager. Thus, preferably, the imager 100 comprises apas- r 4, „ 4 r iL £ j / 

■ r i. i u • * j Tu • • *i_ m reference. The output or the focus assessment is used to 

sive feedback mechanism to guide the user in positioning the 2U . A • j- „ t. *t_ . t 

, „. i 4 . , « • * control an indicator, such as the audible indicator 310. As 

eye 150 to an optimum location to allow acquisition of a * r . , . . 

suitable ima e ^ aS * ocus assessment processor 420 determines that 

sui a e image. ^ captured image is not acceptable for further processing 

The passive feedback mechanism is an indicator or com- and comparison, the audible indicator 310 is directed to emit 

bmation of indicators that provides, on a near real-time periodic sounds to alert the user. Images are repeatedly 

basis, an indication to the user that an adequate iris image acquired and assessed until an acceptable one is received, 

has or has not been obtained. FIG. 5 is a schematic diagram j^^t an accep table iris image has been received, the audible 

of an exemplary iris image recognition system that includes indicator 310 is turned off and the final image is retained for 

position indicators in accordance with the present invention. processing and comparison, for example, by the 

Preferably, the indicator is visible and/or audible, such as, microprocessor 210, as described above, 

for example an indicator lamp 305 (e.g. a light emitting ^ lajam techni for { focusin caQ bc uscd 

diode (LED)) that lights when ^n acceptable image has been ^ ^ . r of ^ m mveatiorl) such as those 

captured (i.e., image acquired ), and a aural indicator via a dcscribcd ^ as . Pat- No . 4)876 ,608, entitled "Focus and 

speaker 310, such as a beep or other tone that sounds signal to Noise Measurement Routines in Input Scanners", 

periodically until an acceptable image has been captured ^ tQ E ^ v g Pat No 5>151f583> entitlcd « Focus 

(i.e., imaging in progress ). Adjustment Device Having Restricting Means for Restrict- 

Additional indicators 306, 307 can be also be used, either mg a Selecting Action According to the Degree of Nearness 

alone or in combination, for such indications as "subject 0 f a Distance Measurement", issued to Tokunaga et al,, and 

identified-accept" and "subject not identified-reject". These TJ.S. Pat. No. 5,404,163, entitled "In-Focus Detection 

indications would be activated pursuant to the results of the 4Q Method and Method and Apparatus Using the Same for Non 

processing and comparison performed at the database server Contact Displacement Measurement", issued to Kubo. The 

at the cellular provider, as described above with respect to preferred system and method for focus assessment is 

FIG. 3. Alternatively, other display devices, such as liquid described below. 

crystal displays used for other purposes within the A focus score is computed for each video frame (i.e., each 

telephone, could be used as indicators. 45 ca p mred image). If me focus score exceeds a predetermined 

The imager 100 also preferably has an on/off switch (not value, then it is determined that the image is focused enough 

shown), such as a pushbutton, for powering up the imager for further processing and comparison. If the focus score 

and initiating the image acquisition process. Power for the does not exceed the predetermined value, then it is deter- 

imager 100 is preferably supplied by a battery. The imager mined that the image is not focused enough for further 

100 receives and acts on instructions from the processor 210 50 processing, and an indicator (such as indicator 310, 

to perform functions such as lighting or turning off the described with respect to FIG. 5) is activated and a further 

indicator lamp(s) 305, providing the audible signals via the image is captured. Alternatively, a sequence of image frames 

speaker 310, and lighting the 'accept' and 'reject' indicators. can be obtained that cycle through a range of focus distances 

FIG. 6 is a more detailed flow chart of a method of strobed at the video frame-rate, and the focus score corn- 
operation in accordance with the present invention. The eye 55 puted for each frame can enable the selection of the best 
is illuminated at step 350 and an image of the iris is obtained focused frame within the sequence of frames. For example, 
at step 355. At step 360, it is determined if the image is by obtaining image frames at each of several different lens 
suitable for use with the image processing and comparison settings and then fitting a spline curve to their respective 
routines. If the image is suitable, the image is passed to the focus scores one can predict the lens position that would 
processor for further processing, at step 370, and transmis- 60 deliver substantially the sharpest focus, by setting the 
sion to the cellular provider. A comparison of the template derivative of the parameterized spline curve to zero and then 
to the templates stored in a database at the cellular provider solving the equation for position. 

is performed at step 373. If the comparison provides a Specific implementation features of the preferred focus 

positive match, then authorization is granted at step 376 for assessment system and method which enable its real-time 

the user to use the phone. If the comparison does not provide 65 operation, include (1) the computation of quantities in the 

a positive match, then authorization is not granted for the 2D Fourier domain, without needing to compute an actual 

user to use the phone. 2D Fourier Transform of an image (this avoids the need for 
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approximately 2.25 million floating-point operations If the convolving optical point-spread function causing 
required for an FFT (Fast Fourier Transform) on a 500x500 defocus is modeled as a Gaussian whose width represents 
pixel image, as the computational complexity of an FFT on the degree of defocus, then defocus is equivalent to multi- 
nxn data is 0(n 2 log 2 n)); (2) only 6,400 integer multiplica- plying the 2D Fourier Transform of a perfectly focused 
tions (squarings) are performed, which in turn can be 5 image with the 2D Fourier Transform of the "defocusing" 
eliminated altogether by using small look-up tables; (3) no (convolving) Gaussian. This latter quantity is itself just 
floating-point operations are required; (4) computation of another 2D Gaussian but in the Fourier domain, and its space 
focus scores is based upon simple algebraic combinations of constant (a) there is the reciprocal of that of the image- 
pixel values within local closed neighborhoods, repeated domain convolving Gaussian that represented the optical 
across regions of the image; and (5) these operations not point-spread function. The preferred focus assessment pro- 
only allow the algorithm to execute in real-time, but it also cessor uses (1) the duality of convolution and multiplication 
enables a straightforward implementation in simple, low- in the two domains; (2) the fact that a Gaussian has a Fourier 
cost, hardware devices that could be embedded within a Transform which is itself a Gaussian, but with the reciprocal 
digital camera or frame grabber. width because of (3) the Similarity Theorem. Thus, the 2D 
Preferably, the focus assessment processor 420 is fast Fourier Transform X)Jji,v) of an image defocused to degree 
enough to determine a focus score for each frame in a video 15 a is related to F(u,v), the 2D Fourier Transform of the 
image stream in less than the time it takes to acquire a new corresponding in-focus image, as given by equation 2. 
frame (e.g., approximately 25 ms). The frame-by-frame 

focus scores can be used to control a moving lens element f " 2 ^ ) (2J 

for rapid and accurate focus control, or alternatively, to Do-fa v) = e ^ 2 fFfa v) 

select which of several frames in a video stream is the one 20 

in best focus. The rapid selection of well-focused video _ . . .^^.^.r • , 44 

frames for further processing, such as image analysis and From ^ above equation, the effect of defocus is to attenuate 

pattern recognition, is important in real-time computer pnmanly the highest frequencies m the image and that 

vision because it prevents wasting processing time on 1 ™ &T ^miency components are virtuaUy unaffected by 

poorly-focused images. 25 defocus smcc the exponential term approaches unity as the 

m r « * A frequencies (u.v) become small. For simplicity, the present 

The preferred focus assessment processor measures the de 7 cri tion £ s 4 sumed isotr ic op^d 4 trop [ c blur> 

™ S^°f imagCS at f f tanda,d UteS ° f 25 (PAL) and the optical point-spread function has been described as 

or 30 (N 1 SL) frames per second. a Gaussian However, the analysis can readily be generalized 

It is contemplated that the focus assessment processor 420 t0 n0 n-Gaussian and t0 anisotropic optical point-spread 

can be implemented in a general purpose personal computer 30 fundus 

(PC) or by a dedicated, low cost processor which is small m effective way to estimate the quality of focus of 

enough to be incorporated into the camera electronics. an image ^ t0 measure its total amount of energy in the 2D 

The processing of a video frame results in the return of ao Fourier domain at high spatial frequencies, since these are 

integer value (on a scale between 0 and 100) reflecting the thc most attenuated by defocus. One may also perform a 

quality of focus; the larger the value of the integer, the better 35 kind of « contrast normalization" to make such a spectrally- 

the focus. A value of 0 indicates a completely defocused based focus me asure independent of image content, by 

image whereas the value of 100 indicates maximum focus comparing the ratio of energy in the highest frequency bands 

quality. A predetermined threshold is used to determine t0 tQat in slightly lower frequency bands. Such spectrally- 

whether an image is sufficiently focused or whether another based energy measurements are facilitated by exploiting 

image needs to be retrieved. For example, values greater *o Lord Rayleigb's theorem for conserved total power in the 

than about 40 can indicate sufficient quality of focus to two domains, shown in equation 3. 
warrant further image processing, while values less than 

about 40 cause a new image frame to be grabbed, and p« ^ p*. p+» ^ 

optional feedback provided to the focusing mechanism, if J ^ J ^ I'l* vf**** = J ^ 1^0*. vfd/idv 

one exists, or to the subject controlling the camera positioo 45 
(via the indicator 310, for example). 

Optical defocus is a phenomenon of the 2D Fourier high-pass filtering or band-pass filtering an image at 

domain. An image represented as a 2D function of the real a ring of high spatial frequency (using only convolution in 

plane, I(x,y), has a 2D Fourier Transform F(u,v) defamed as thc 2D ima S e domain) and measuring the residual energy, is 

shown in equation 1. 50 equivalent to making the corresponding energy measure- 
ment in the high frequency bands of the 2D Fourier domain. 

l r r (j) The appropriate measurements in the 2D Fourier domain to 

F fa W = J J ^y)^^ vy) dxd y assess focus can be performed without computing a time- 

y consuming 2D Fourier Transform. Indeed, the measure- 

55 ments can be performed without even a single floating-point 
In the image domain, defocus is preferably represented as operation, and even without any multiplications if appropri- 
convolution by the 2D point-spread function of the defo- ate convolution kernels and look-up tables are used, 
cused optics. This in turn may be modeled as a Gaussian A real-time procedure for focus assessment based on these 
whose space constant is proportional to the degree of theoretical principles is used in the focus assessment pro- 
defocus. Thus, for perfectly focused optics, the optical 60 cessor 420. It executes much faster than the video frame- 
point-spread function shrinks almost to a delta function, and rate, and so real-time focus assessments can be made on a 
convolution with a delta function causes no change to the frame-by-frame basis. These can be used either to control 
image. Progressively defocused optics equates to convolv- the position of a focusing lens element, or alternatively as a 
ing with a wider and wider point-spread function, which type of autofocus system in which frames are grabbed at a 
averages together whole neighborhoods of pixels by such a 65 variety of focal depths in order to select only the best one for 
weighting function, thereby producing an increasingly processing, or to prevent time being wasted on processing 
blurred image. image frames which are assessed to be in poor focus. 
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The 2D spectral measurements described above can be x 2 /(x 2 +c 2 ) in order to generate a normalized focus score in 
implemented by convolving an image with the following the range of 0 to 100 for any image, 
convolution kernel, in which pixel values within a prede- The focus assessment technique is applied immediately 
termined region, such as, for example, an (8x8) after cacn image frame is digitized and stored in the frame 
neighborhood, are added together with the weights indicated s buffer memory 410 in order to assess whether the focus 
in each of the cells: quality is sufficient to warrant any further processing. If the 

calculated focus quality value of the captured image is 
greater than or equal to a predetermined value, the image is 
passed to applicable programs for further processing, for 
ao example for extraction of a biometric template. The focus 
assessment technique can be used to compare the relative 
focus of an entire series of images in order to select the one 
most in- focus (i.e. having the highest focus assessment 
score), as well as to measure a single image. 
35 The focus assessment technique can be used to provide a 
feedback indication to a system user who controls the 
It should be noted that no pixel-by-pixel multiplications are position of the imager relative to the object being imaged, 
needed in order to impose these weights. Rather, the pixels ™s can be accomplished by activating an indicator which 
in the central region are added together, such as the (4x4) would continue, while successive images are captured and 
square, that sum is tripled, and then all pixel values in the 20 their focus assessed, until the focus assessment score 
outer two pairs of rows and columns are subtracted from the exceeds a predetermined value. At this point, the indicator is 
tripled sum. The result is squared and added to an deactivated and the last image captured is transferred to the 
accumulator, thus implementing the left-hand side of equa- image processor 210 where it is processed to extract the 
tion (3) above for this local region of the image. The biometric template. 

complete (8x8) convolution kernel is then moved to a new 25 The application of the focus assessment technique in 
position in the image, along a sampling grid that selects combination with the feedback indicator helps resolve the 
every 4th row and every 4th column, and the operation is man-machine interface problems associated with the use of 
repeated. Thus, to assess the quality of focus within the digital imaging devices on the eye. Individuals using the 
central (320x320) region of an image, this set of 64 pixel system are provided positive, objective indicators and feed- 
summations foUo wed by a squaring operation is repeated a 30 back ^ to me quality of image focus ^ focus assessment 

tot T ?u ( ™ V = ■ ' ^ UmeS \u * 1 , processor can also be used in any situation where it is 

In the 2D Fourier domain, the spectral consequences of dctermke ^ 

this operation can be appreciated by examining the 2D J standard frame ^ ( ^ c afld pAL) 

Fourier Transform of the convolution kernel above. The Jr * V v A auu >\ . , 

kernel is equivalent to the superposition of two centered , ^ * c «™S* * tamed at ^cmu&r and transmitted 

square box functions, one of size (8x8) and amplitude -1, 35 to / n analog to digital converter 405. The digitized video 

and the other of size (4x4) and amplitude +4 (for the central ^formation is then stored in a frame buffer memory 410, 

region in which they overlap, the two therefore sum to +3). ™ e focus assessment processor 420 isolates the central 

The 2D Fourier Transform of each of these square functions 320x32 ° region of the image. 8x8 pixel blocks (each pixel 

is a 2D "sine" function, whose size parameters differ by a * in only one block) are then processed by first summing 

factor of two in each of the dimensions and whose ampli- 40 P*f ls m ^ central 4x4 region tripling that sum, and then 

tudes are equal but opposite, because the two component subtracting from this value all the pixel values in the outer 

boxes have equal but opposite volumes. Thus, the overall ^° pairs of roWS * nd ^i™^ T^ S ^\ * th ^ u ^ d ' 

kernel has a 2D Fourier Transform Kfcv) which is the ^process is performed on each 8x8 block, and the results 

difference of two differently-sized 2D sine functions, as are summed. After the entire image has been processed, the 

given by equation 4 45 summe ^ result is compressed nonlinearly to generate a focus 

score between 0 and 100, This score is then compared to a 
predetermined number for determining if the indicator 310 


sin{M)$in(v) sin(2/i)sin(2v) (4) 


K(fr v) = , — > should be activated. 


The focus assessment is preferably performed by the 
50 microprocessor 210, or it can be a separate processor ele- 
This is a high-pass (or ultimately a band-pass) filter, ment within the telephone, 
selecting only a high range of spatial frequencies in all It is contemplated that in addition to the focus assessment 
orientations. Towards its center, corresponding to very low processor, an auto-focus lens system could be used in the 
spatial frequencies, its value approaches zero (as can also be present invention. The results of the focus assessment con- 
inferred from the fact that the sum of all pixel weights in the 55 trol the lens system, thereby automatically adjusting focus to 
convolution kernel shown above is zero). Thus, low fre- produce an optimal image. This would place less of a 
quencies play little or no role in computing a focus score, premium on the accuracy with which the user positions the 
and only relatively high frequencies contribute significantly eye, and would be helpful if the user could not see or hear 
to the computation of a focus score. Equation (3) shows that the indicators described above. 

summing the squares of all the local convolution sums 60 The iris imager of the present invention can be used as a 

across the image is equivalent to summing the total amount security module for electronic devices such as a telephone, 

of high frequency energy in the 2D Fourier Transform of the FIG. 8 is a schematic diagram of an exemplary iris imager 

image. The action of the convolution kernel is to impose the incorporated into a telephone in accordance with the present 

above power spectral weighting function so that primarily invention. The imager 700 comprises the camera 105, lens 

high frequency energy is measured. 65 110, mirror 120, and illuminator 130, as described above 

Finally, the summated 2D spectral energy is passed with respect to FIG. 1. The imager 700 also comprises 

through a compressive nonlinearity of the form f(x)«100 visible indicators 555, 556, 557, which are similar to indi- 
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cators 305, 306, 307, respectively, described above with 
respect to FIG. 5. An audible indicator 560, similar to 
indicator 310, is also disposed within the imager 700. The 
imager 700 further comprises electronics and circuitry 500 
for processing and comparing the obtained image. The 5 
electronics and circuitry 500 comprises a microprocessor 
510 (similar to microprocessor 210) that controls the imager 
700 along with an I/O controller 525 and runs software held 
in a ROM 505. The processor 510 is connected to the ROM 
505, a RAM 532 that is capable of storing at least one 10 
captured image or an iris, another memory 530, such as an 
EPROM, for storing a plurality of biometric templates or iris 
images that are to be compared with the captured iris image. 
The electronics and circuitry 500 is also connected to the 
camera 105, the illuminator 130, and the indicators 555, 556, 15 
557, 560 for controlling these elements of the imager 700. 
The processor can also comprise a focus assessment 
processor, similar to the focus assessment processor 420. 

It should be noted that in the embodiment of FIG. 8, the 
database memory 530 of templates is stored within the 20 
imager 700 and not at a central station (as described, for 
example, with respect to FIG. 4), as is the processor 510 
used in the comparison. In the embodiment of FIG. 8, the 
comparison of the captured image template with the stored 
templates takes place locally within the telephone, and no 25 
data is sent to the central station for comparison or authen- 
tication. 

The imager 700 is coupled to telephone electronics 570 
for transmitting encrypted or unencrypted data to another 
telephone or system via an antenna. The telephone electron- 30 
ics 570 is essentially a telephone and is preferably a con- 
ventional cell phone having telephone electronics and is 
connected to a transmission antenna. Preferably, a conven- 
tional voltage regulator (not shown) provides the appropriate 
operating voltage to the imager 700 from the power supply 35 
(e.g., a battery) of the phone. 

Preferably, the imager 700 of the present invention is 
incorporated into a handset of a telephone 575, as shown in 
FIG. 9. The present invention can be incorporated into a 
conventional digital cell phone, as shown in FIG. 9, such as 40 
those manufactured by Qualcomm. 

FIG. 10 is a flow diagram of an exemplary method of 
operation of a telecommunications iris imager in accordance 
with the present invention. A user desiring to make a 
telephone call first unlocks the telephone by having his iris 45 
identified by the imager residing within the phone. The eye, 
and thus the iris, is illuminated at step 605. An image is 
obtained of the iris at step 610. At step 615, it is determined 
if the image is suitable for further processing and 
comparison, as described above. If the image is not suitable, 50 
the appropriate indicators are activated at step 620, and 
processing returns to step 610 with the capture of another iris 
image. 

If the captured image is suitable for further processing, the 
image is processed at step 630 (an indicator can be activated 55 
to alert the user that a suitable image has been captured) and 
is compared to the stored images residing in a database, for 
example, in a memory, at step 635, If there is no match 
between the captured image and the stored images, at step 
640, the appropriate indicators are activated at step 645, and 60 
the imaging routine exits. In this manner, the telephone 
remains locked, and cannot be used because it is determined 
that the user is unauthorized. 

If there is a match between the captured image and the 
stored images, at step 640, the phone is unlocked (and an 65 
indicator can be activated) at step 650, and the user is then 
able to use the phone to place a call, for example. The phone 
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can be returned to its locked, secure state either upon being 
powered down or upon completion of the phone call. 

Although illustrated and described herein with reference 
to certain specific embodiments, it will be understood by 
those skilled in the art that the invention is not limited to the 
embodiments specifically disclosed herein. Those skilled in 
the art also will appreciate that many other variations of the 
specific embodiments described herein are intended to be 
within the scope of the invention as defined by the following 
claims. 

What is claimed is: 

1. A telephone security module comprising: 

iris acquisition means having a front surface for obtaining 

an image of an iris of an eye; 
a lens having a image plane disposed in front of said front 

surface of said iris acquisition means; 
a mirror disposed on a side of said lens opposite said iris 

acquisition means; 
an illuminator disposed along a side of said mirror; 
a memory for storing an iris image obtained by said iris 

acquisition means; 
a processor for extracting a template from said stored iris 

image; and 

a communications interface for transmitting said template 
to a central station. 

2. The telephone security module according to claim 1, 
wherein said iris acquisition means comprises a camera, and 
said mirror is a cold mirror. 

3. The telephone security module according to claim 2, 
wherein said camera is sensitive to light having a wave- 
length in a range between about 400 nm and about 1100 nm. 

4. The telephone security module according to claim 2, 
wherein said mirror reflects light having a wavelength in a 
range between about 400 nm and about 700 nm and passes 
light having a wavelength greater than about 700 nm. 

5. The telephone security module according to claim 1, 
wherein said illuminator emits light having a wavelength in 
a range between about 680 nm and about 900 nm towards 
the iris of the eye being imaged, the eye being out of contact 
with the iris imaging apparatus. 

6. The telephone security module according to claim 1, 
further comprising at least one of a visible indicator and an 
audible indicator to indicate when the image of the iris has 
been obtained. 

7. The telephone security module according to claim 6, 
further comprising a focus assessment processor coupled to 
said at least one of a visible indicator and an audible 
indicator. 

8. The telephone security module according to claim 1, 
wherein said processor unlocks a telephone responsive a 
signal received from said central station. 

9. A system of identification of a person for unlocking a 
telephone, comprising: 

the telephone security module of claim 1; 

a second memory for storing at least one template of at 

least one image of an iris of at least one person's eye; 

and 

a second processor for comparing said template of said 
stored iris image with said at least one stored template 
of said second memory to identify the person, and for 
unlocking the telephone responsive to the result of said 
comparison. 

10. The system according to claim 9, wherein said second 
memory and said second processor are housed in a central 
station remote from the telephone security module. 
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11. The system according to claim 9, wherein said second 22. The telephone security module according to claim 20, 
processor unlocks the telephone when said template of said wherein said mirror reflects light having a wavelength in a 
stored iris image substantially matches said at least one range between about 400 nm and about 700 nm and passes 
stored template of said second memory. n ^ t having a wave iength greater than about 700 nm. 

12. A telephone security module comprising: s ^ m telephone module accQrding tQ cUim 20 

iris acquisition means havmg a front surface for obtaining wherein said illuminator emits light having a wavelength in 

an image of an ins of an eye; a rang<? bctwcen about 680 nm about 900 nm towards 

a lens having a image plane disposed in front of said front me iris of me eye being imaged> the eye 5eing ollt of contact 

surface of said iris acquisition means; • ■ ■■„„ 0 „„ omH ^ 

^ ' 10 with the iris imaging apparatus. 

a mirror disposed on a side of said lens opposite said iris 24. The telephone security module according to claim 20, 

acquisition means; further comprising at least one of a visible indicator and an 

an illuminator disposed along a side of said mirror; audible indicator to indicate when the image of the iris has 

a first memory for storing at least one template of at least been obtained. 

one image of an iris of at least one person's eye; 15 25. The telephone security module according to claim 24, 

a second memory for storing an iris image obtained by further comprising a focus assessment processor coupled to 

said iris acquisition means; said at least one of a visible indicator and an audible 

a processor for extracting a template from said stored iris indicator. 

image; and 26. The telephone security module according to claim 20, 

a comparator for comparing said template from stored iris 20 wherein said Processor unlocks a telephone responsive a 

image with said at least one template to identify the si S nal received from said central station. 

person. 27. A telephone security module comprising: 

13. The telephone security module according to claim 12, a camera having a front surface for obtaining an image of 
wherein said iris acquisition means comprises a camera, and 25 an iris of an eye; 

said mirror is a cold mirror. a lens havin a ^ kne ^osed in front of said front 

14. The telephone security module according to claim 13, flf ^ ^ 
wherein said camera is sensitive to light having a wave- . 

length in a range between about 400 nm and about 1100 nm. a concave cold mirror disposed on a side of said lens 

15. The telephone security module according to claim 13, 3Q opposite said camera; 

wherein said mirror reflects light having a wavelength in a an illuminator disposed along a side of said mirror; 

range between about 400 nm and about 700 nm and passes a first memory for storing at least one template of at least 

light having a wavelength greater than about 700 nm. one imagc of an of at least one person's eye; 

16. The telephone security module according to claim 12, second m for fln obtained 
wherein said illuminator emits light having a wavelength in 35 *h • 

a range between about 680 nm and about 900 nm towards sai camera » 

the iris of the eye being imaged, the eye being out of contact a processor for extracting a template from said stored iris 

with the iris imaging apparatus. image; and 

17. The telephone security module according to claim 12, a comparator for comparing said template from stored iris 
further comprising at least one of a visible indicator and an 4Q image with said at least one template to identify the 
audible indicator to indicate when the image of the iris has person. 

been obtained. 28. The telephone security module according to claim 27, 

18. The telephone security module according to claim 17, wherein said camera is sensitive to light having a wave- 
further comprising a focus assessment processor coupled to lengm in a range between about 400 nm an d about 1100 nm. 
said at least one of a visible indicator and an audible 45 2 9. The telephone security module according to claim 27, 

m ^ a r 2, r * , t . . - , . wherein said mirror reflects light having a wavelength in a 

19. The telephone security module according to claim 12, between about ^ nm and aboul JQ0 nm and 

wherein said processor unlocks a telephone responsive to the . . ' * , . . , ^ . r 

i , q m r r light havmg a wavelength greater than about 700 nm. 

results of said comparison. in ~. , .° , . ,. . - . 

20. A telephone security module comprising: m ^ 7*° ^ on * eecmt y accord ^S to claim 27, 

, . . r wherein said illuminator emits light having a wavelength in 

a camera having a front surface for obtaining an image of . . , ,, ori , , , nAn t , 

an iris of an e e* a ran ? e Detwecn about 680 nm and about 900 nm towards 

an iris o an eye, ^ e ^ ^ ^ being imaged, the eye being out of contact 

a tens having a image plane disposed in front of said front with ^ ^ imaging apparatus . 

surface of said camera; 31 ^ telephone security module according to claim 27, 

a concave cold mirror disposed on a side of said lens 55 father comprising at least one of a visible indicator and an 

opposite said camera; audible indicator to indicate when the image of the iris has 

an illuminator disposed along a side of said mirror; been obtained. 

a memory for storing an iris image obtained by said 32. The telephone security module according to claim 31, 

camera; 60 further comprising a focus assessment processor coupled to 

a processor for extracting a template from said stored iris said at least one of a visible indicator and an audible 

image; and indicator. 

a communications interface for transmitting said template 33. The telephone security module according to claim 27, 

to a central station. wherein said processor unlocks a telephone responsive to the 

21. The telephone security module according to claim 20, 65 results of said comparison, 
wherein said camera is sensitive to light having a wave- 
length in a range between about 400 nm and about 1100 nm. ***** 
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